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A KIEFER WOLFOWITZ COMPARISON THEOREM FOR 
WICKSELL'S PROBLEM 

By Xiao Wang and Michael Woodroofe 
University of Maryland Baltimore County and University of Michigan 

We extend the isotonic analysis for Wicksell's problem to esti- 
mate a regression function, which is motivated by the problem of 
estimating dark matter distribution in astronomy. The main result is 
a version of the Kiefer-Wolfowitz theorem comparing the empirical 
distribution to its least concave majorant, but with a convergence 
rate logn faster than n~^^^ logn. The main result is useful in ob- 
taining asymptotic distributions for estimators, such as isotonic and 
smooth estimators. 

1. Introduction. Our starting point is Groeneboom and Jongbloed's [5] 
analysis of Wicksell's [12] "Corpuscle Problem," in anatomy: Given cross- 
sections of a large number of corpuscles of different sizes, the distribution of 
radii of corpuscles was to be estimated. Assuming corpuscles were spherical, 
the relation between the distribution of the corpuscle radii and the distribu- 
tion of the observable circular sections was derived. Wicksell approximated 
the density of spherical radii by a step function and then used the distri- 
butional relationship between spherical radii and circular radii to estimate 
the distribution of spherical radii. Groeneboom and Jongbloed [5] showed 
how isotonic techniques can be used in Wicksell's problem. They related 
the distribution of spherical radii to a nonincreasing function that can be 
estimated unbiasedly. The unbiased estimate was not monotone, however, 
and they showed how it can be improved by imposing the shape restriction. 

Here we extend the isotonic analysis to estimate a regression function. The 
extension is motivated by the problem of estimating the velocity dispersions 
in astronomy which, in turn, is motivated by the problem of estimating 
the distribution of dark matter, as explained in [11]. Let X = {Xi,X2,X^) 
and V = (Vi,V2,V3) denote the three-dimensional position and velocity of 
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a star and suppose that the distribution of X and V has a density that 
depends only on the Euchdean norms ||x|| and ||v||. We cannot observe a 
sample of three-dimensional star positions and velocities directly. What we 
can observe is the projected stellar positions and the line-of-sight of velocity 
components. With a proper choice of coordinates these become a sample 
of {Xi,X2,V3). An important quantity to estimate is the velocity disper- 



sion, y/E{\\'V\\'^\R = r), where = -y/xf + X| + X|. Due to the isotropy, 

E{\\Yf\R = r) = 3E{Vi\R = r). Clearly, 



where (/>(r) = / v'^fr,v{''',v) dv, fr{x) is the density of R and fr,v{r,v) is the 
joint density of R and V. We focus on estimating the function (p in (1). 
The function /r can be estimated similarly (and was in [5]). Moreover, since 
positions are easier to measure than velocities, there may be additional in- 
formation for estimating fr, as in [7]. 

Our main result is a version of the Kiefer-Wolfowitz theorem [8] compar- 
ing the empirical distribution function to its least concave majorant, but 
with a faster rate of convergence. In the next section, we relate (p to the 
derivative of a nondecreasing concave function U that can be estimated un- 
biasedly by a nondecreasing, but nonconcave function C/jf . Letting Un be 
the least concave majorant of U^, we show that (under appropriate condi- 
tions) supj{7„(t) — Uf{t)\ = Op[log(n)/?i]. In fact, a more general result is 
obtained, and the result is new even when specialized to the context of [5]. 

The paper is organized as follows. In Section 2 we establish the notation 
for several estimators and state the main result. The main result is useful 
in obtaining asymptotic distributions for estimators. Two such applications 
are presented in Section 3. An example with simulated data is presented 
in Section 4. Proofs are presented in Sections 5-8. Our study of Wicksell's 
problem follows Groeneboom and Jongbloed [5] . There are several other ap- 
proaches to study Wicksell's problem in the literature. These include Hall 
and Smith's kernel method [6], Antoniadis, Fan and Gijbels's wavelet anal- 
ysis [1] and Gobubev and Levit's asymptotically efficient estimation [4]. 

2. The main results. Let X = {Xi^X2,X-i) be a random vector and Z a 
nonnegative random variable. We suppose throughout that the joint distri- 
bution of X and Z is invariant under orthogonal transformations of X and 
also that X and Z have a joint density with respect to a product measure 
A'^ X u, where A'^ is three-dimensional Lebesgue measure and is a sigma 
finite measure on the Borel sets of [0,oo). For example, if X is position and 
Z = Vi, then the invariance requires spatial symmetry. The relation between 
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£^(||V|p|i? = r) and E(y:^\R = r) requires isotropy, but the estimator of 
does not. If (X,Z) are as described, 

(2) P[x<X<x + (ix,z<Z<z + dz] = p{r;z)dyiv{dz}, 

where = xf + + Xg and p is a nonnegative measurable function on 
[0, oo)^. Then p{r) = /q°° p{r, z)i>{dz^ defines a marginal density for X. Inter- 
est centers on estimating £(Z|X = x) from an observed sample of (Xi, X2, ^). 

It is convenient to work with squared radii, X = Xf + + X^ and Y = 
Xf + X2 , as in [5] . Let / and g denote the densities of the pairs {X, Z) and 
(y, Z) with respect to A x z^, where A is one-dimensional Lebesgue measure. 
Thus /(x, z) = 27ry^/9(y^, z) and 

/ N f°°p(x,z)dx 1 f(x,z)dx 
g{y,z) =Tr - 

Then 



y y/x-y 2jy y/x{x-y) 
E{Z\X = x)- '^(^^ 



where 

(3) 'f{x)= 1 zp{\/x,z)dz. 



We focus attention on estimating ip. Estimating p{^/x) is then a special case 
with Z = 1. 
Let 



00 







V'(y) = / zg{y,z)u{dz]. 
Then ip and ijj are related by 
(4) ^{y) = TT 



ip{x) dx 
y \/x-y' 
The transformation (4) can be inverted. Let 

ij{t)dt 



(5) ^(y) 
Then 



y 



(6) ^'(y) =7r^ / p{x)dx 

Jy 

by reversing the orders of the integration in (5) and recognizing a Beta 
integral. It follows that <p{x) = — ^'(x)/7r^, so that estimation of (p may 
proceed by estimating ^ and its derivative. Observe that, from equation (6) 
and the assumption that Z is nonnegative, ^' is a nonincreasing function. 
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Suppose now that there is a sample Xj^2; Zi), i = 1, . . . ,n, assumed 

to be i.i.d. as {Xi,X2,Z). Let Yi = Xf^+Xf^ and 



Then is an unbiased estimator of ^'(y) for each y, but is not monotone 

when viewed as a function of y: has an infinite jump at each observation 
Yi, as indicated imperfectly in Figure 2. We call the naive estimator. This 
naive estimator can be improved by imposing shape restriction. If were 
square integrable, this could be accomplished by minimizing the integral of 
(W — ^*)^ over non-increasing functions W, or equivalently, by minimizing 

/•OO /"OO 

(8) / W^{x)dx-2 W{x)'i'*{x)dx. 
Jo Jo 

The function is not square integrable, but it is integrable, so that (8) is 
well defined. Let be the nonincreasing function W that minimizes (8). 
Existence and uniqueness can be shown along the lines of Theorem 1.2.1 of 
Robertson, Wright and Dykstra [9], replacing the sums by integrals. 
To describe in more detail, let 

(9) U{x)= ^{t)dt= / 2z[^ -\/{y- x)+]9{y, z)v{dz} dy, 



10 Jo Jo 

where z+ = max[0, z], and let 



(10) U*{x)= r ^*{t) dt = -J2 'iZ.,{^, - ^{Y, - x)+). 

Jo n 

Then [/ is a nondecreasing, concave function, a nondecreasing one and 
is the derivative of Uf, at least almost everywhere. Let Un be the least 
concave majorant of Uf. Then ^„ is the right derivative of Un- Letting 



(11) en = 

the main results of the paper are: 



'log(ra) 



n 



Theorem 2.1. Suppose that Z is a bounded random variable. Let 0< 
t^ <ti<Qo and suppose that U is twice continuously differentiable on \to,ti] 
and that 

(12) 27o:= inf [-U"{t)]>Q. 

to<.t<.ti 

Then 

(13) sup \Un{t)-U*{t)\=Op[el]. 

to<t<ti 
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Theorem 2.2. Suppose that Z is a bounded random variable and U is 
twice continuously differentiable near x with U"{x) < 0. Then 

(14) sup \Un(,t)-U*{t)\ = Op[el]. 

\t—x\<e„ 

The proofs of Theorems 2.1 and 2.2 are presented in Sections 6 and 7. 
3. Applications. 

Estimating ^. From Theorem 2.1 Un and are asymptotically equiva- 
lent. The following two theorems show that the derivatives and ^„ are 
not. Let 

(T^(x) = / z^g{x,z)i'{dz}. 



Theorem 3.1. For each x>0 for which a'^{x) is continuous in a neigh- 
borhood of x, 



V logn 



as n ^ oo. 



Theorem 3.2. For each x > for which a'^{x) is continuous in a neigh- 
borhood of X, 



I ri ~ 

J- {^nix)-^{x))^N 

V iogn 



as oo. 



In the special case that Z = 1, Theorems 3.1 and 3.2 are special cases of 
Theorems 2 and 5 in Groeneboom and Jongbloed [5] . We provide a different 
proof for Theorem 3.2 using Theorem 2.2 in Section 8. 

Estimating (p. Extend and to (—00,00) by letting ^^{t) = ^'*(0) 
and ^n(i) = ^'n(O) for t < 0. Then, we may obtain a smooth estimator of ^ 
by using the kernel method, 

(15) *„,.(x) = j°^j^Ki^-^y*it)dt, 

where K \s a. kernel and 6 is a bandwidth. Due to the irregular behavior of 
'^n,s is not a nonincreasing function. If we replace the naive estimator 
by the isotonized estimator ^„ in equation (15), we can obtain a smooth 
and nonincreasing estimator of 

(16) §„,.(x) = li^('i_^')§„(t)dt. 
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Differentiating (15) and (16) can give us tlie estimates of tlie derivative of 
the function ^. For instance, to estimate ^' , we have the estimators based 
on or ^, 

and 

(18) Ksi^)=- 

Hah and Smith [6] studied ^ for the density estimation problem [Z = 
1). They showed that the optimal order for the bandwidth is n~^/^ under 
broad conditions that also imply that re^/^[^^ g{t) — ^'{t)] is asymptotically 
normal. As a consequence of Theorem 2.1, we may show that ^'^ ^ and ^ 
have the same asymptotic distribution, under broad conditions that include 
the optimal order for the bandwidth. 



Theorem 3.3. Suppose that K is twice continuously differentiahle and 
has support [—1,1]. If Z is hounded, ^ is positive and continuous at < x < 
oo, b = bn^ and nb oo, then 



log(n 



Proof. Since ip is positive and continuous at x, there are t^ < x <ti 
for which (12) holds. If n is sufficiently large, then [x — h,x + h\ C [to, ^i] and, 
therefore, 



x+h -y ^ 
x-b b"^ 



< 



I fx+b 



63 



Or, 



K" 



x—b 

log(n 



t — X 

t — X 



[^n{t)-^*{t)]dt 
Unit) - U*{t) dt 



□ 



4. Simulations. To illustrate the nature of the estimators, we use a sim- 
ulated sample from Plummer's distribution [2], page 205. In Plummer's dis- 
tribution, the joint density of X = (Xi, X2, X3) and Z = is 



Co 



/35 



1 5 



v/l + (l/3)r^ 2 
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Fig. 1. Simulated Y and V3 pair. 



where cq is a normalizing constant and /3 is a parameter that is related to the 
velocity dispersion through E[Z\R = r] = /3/[6-\/l + {l/3)r'^]. For this case, 

48 (l + (l/3)y)2- 

A sample of 1500 (y, V3) pairs, simulated from the above distributions 
with (3 = 200, is shown in Figure 1. The naive estimator may be com- 
puted from these data using equation (7). This function is shown in Figure 
2 along with the improved estimator and kernel estimator ^n,s- As ex- 
pected, that is a highly irregular function and is a decreasing step 
function. The estimator ^n,s is a smooth function. Figure 3 shows the esti- 
mator ^'n^s of the first derivative of In all cases, the dashed line represents 
the true function computed directly from the true distribution. The band- 
widths in Figures 2 and 3 were 1.5 and 3.7, respectively. These were chosen 
by inspection to compromise between fit and smoothness. 

5. Localization lemmas. A question that arises in the proofs of Theorems 
2.1 and 2.2 is the relation between the least concave majorant of a restricted 
function and the restriction of the least concave majorant. This question is 
of some independent technical interest. 
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y y y 

Fig. 2. Naive, isotonized and smooth estimates of ^ . 

Lemma 5.1. Let f he a hounded continuous function on [0,oo), let f 
be its least concave majorant, and let < a < a' < oo and c = (a + a')/2. If 
f{c) > [f{a) + /(a')]/2, then f{t) = f{t) for some a<t<a'. 



Proof. ^ If /(c) > [/(a) + /(a')]/2, then clearly /(c) > [/(a) + f{a')]/2. 
Let g{t) = f{t) for t < a and t > a' , and let 



{t-a)f{a') + {a'-t)f{a) 



g{t) = {l-e)fit)+e 



for a<t<a', where < e < 1. Then g is concave on [0, oo) for any < e < 1, 
and g{t) < fit) for all t with strict inequality if t = c. If f{t) < f{t) for 
a<t<a\ then there is an e > for which f[t) < g{t) for a <t < a' , and 
this would contradict the definition of /. □ 



Lemma 5.2. Let f he a hounded function on [0,oo) and let f be its 
least concave majorant. Further, let < zq < xq < to < ti < xi < zi < co 
with strict inequality throughout if to > 0, and let f* he the least concave 
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y 

Fig. 3. Estimator of 'i/' . 

majorant of the restriction of f to [^0,2:1]. If f{xi) = f{xi), i = 0, 1, then 
fit) = f*{t) for xo<t<xi. 

Proof. It is clear that f*{t) < f{t) for all t G [xo,xi] and suffices to 
establish the reverse inequality. It is also clear that f{xi) = f*{xi), since 
f*ixi)>f{xi). Let 

(fit), ift<xo, 
f+(t) = l f*{t), iixo<t<xu 
[fit), ift>xi. 

Then > / everywhere. It is shown below that /"*" is concave. It then 
follows that > /, and this implies f*{t) > f{t) for xq <t < xi. 

The restrictions of to each of the intervals [0,a;o], [xo,xi] and [2:1,0x0) 
are clearly concave. So, the question is whether the derivative of f^ is non- 
increasing as t crosses xq and xi. Consider xq. The issue does not arise if 
to = 0; and if tQ > 0, then the left- and right-hand derivatives of /"*" at xq 
are related by 

Drf (Xq) = hm 

~ eJ.0 £ 
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= Drfixo) < Dj{xo) = Dif+{xo). 
Global concavity follows from this and a related calculation at xi. □ 

6. Proof of Theorem 2.1. The assumptions of Theorem 2.1 are made 
throughout this section, and the proof is divided into several steps. Let 
< to < < and 70 be as in the statement of that theorem. 



Step 1. For suitably chosen wq <t{), with equality when to = 0, and 
wi > ti, let U* be the least concave majorant of the restriction of C/* to 
[ifc'i'^i]- Then 



(19) 



lim P[Un{t) = U*{t) for all t G [to,ti]] = 1. 



Step 2. Next, partition the interval [ifJojW^i] into kn equally-spaced 
subintervals [a^" , Oj+i] , j = 0,1, . . . ,kn — l, where kn is a sequence of positive 
integers for which log(n) <kn< \/n, to be specified in detail later. Thus, 



wj 

w^o + T— 5 J =0,1,. 



' ) kn. 



where w = wi — wq. Define two continuous piecewise linear functions L''" 
and L^" with knots at a*^" by L''"{aj") = J7(a^") and = U*{a^j") 

for j = 0,1, . . . , kn- Let An be the event that L^" is concave. In Step 2, it is 
shown that P{An) ^ 1 as n — > 00, for suitably chosen kn- 



Let 



sup{|/(t)| :te [wo,wi]}. 



Step 3. If An occurs, then \\U* - U*\\ < 2||L^" - U* + U - L''"\ 
2||L^" - U\\. 



Step 4. There are constants C, Ti and r2 for which 



(20) 
and 

(21) 



^11 



P 



\L'n--U*-iU-L'^-)\\> 



v/Alog(n) 



<Cfc^[log(n)]^exp 



y/nkn 
Alog(n)" 



r, 



for all < A < log(7T,) for all sufficiently large n. 
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It is then shown that the resuhs in Steps 1-4 imply (13) with suitable 
choice of kn- 

In the first proposition, let wq < to and wi > ti be so chosen that 
sup^Q<t<^j U"{t) < —70 and wq < Iq if > 0. In the proof, use is made of 
the following elementary observations: supo<(<oo l^^rf (*) — C^(t)| — > w.p.l 
by the strong law of large numbers applied for fixed t and the monotonicity 
of C/jf , as in Polya's theorem; and then 

(22) sup \Unit)-U{t)\< sup \U*{t) -U{t)\^0 w.p.l 

0<t<oo 0<t<oo 

by Marshall's lemma. 

Proposition 6.1. Relation (19) holds. 

Proof. By Lemma 5.2, it suffices to show that Unit) = Uf{t) for some 
t G [t^Oi^o] and also for some t G both with probability approaching 

one. The two cases are similar. Details are supplied for the first. The relation 
is clear if to = 0. If to > 0, let xq = {wq + to)/2. Then it suffices to show that 
Uf{xo) > [tJn{wQ) + f^n(io)]/2 with probability approaching one, by Lemma 
5.1. This is clear, however, from (22) and the strict concavity of U which 
implies U{xq) > [U{wo) + U{to)]/2. □ 

This accomplishes Step 1. For the next step, let Q denote the distribution 
of {Y,Z), II • \\r the norm in L^{Q) and the empirical distribution of 
iYi,Zi), i = l,...,n. Then 

1 " 

U*{t)=Q*ht:=-Y.ht{Y^,Z,), 
1=1 

where 

ht{y, z) =2z[^- ^{y-t)+\ 
and (y — t)_|_ = max[?/ — t,0]. For later reference observe that 



(23) |/it-/i.| <2co^|t-s|, 

where cq is an upper bound for Z. 

Lemma 6.1. Let ujq < a < b < uJi. There is a constant such that if 
|s — t| < 1, then 



(24) ||/it-/is||2<r3|t-s|^log- 
and for all a<t <b, 



(25) 



, {t-a)hb + {b-t)ha 
lit ; 



<r3(6- 

2 
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Proof. The square of the left-hand side of (24) is at most 

rt+l 



4c, 



[\/ (y - s) - \/iy-t)+fg{y) dy 



t+l 



V (y - s) - \l{y-t)fg{y) dy. 



Letting ci be an upper bound for g, the first integral is at most 4cqCi(s — 

i? /o (\/^ - dz < 4cgci(s - tf log(l/|s - t\) and the second 

integral is less than 4cqCi(s — t)"^. Thus (24) follows. The square of the left- 
hand side of (25) is at most 



4c, 







{t - a)^{y - b)+ + {b- t)^{y - a)+ 



b — a 



9{y)dy 



for a<t<b. Letting y = a + {b — a)z and t = a + {b — a)s, the last integral 
is at most 

/■oo 

4cgci(6 



fj^ {^{z - s)+ - [s^{z - 1)+ + (1 - s)V~z]f dz. 



The integrand in the last expression is continuous and of order as 
z ^ oo uniformly in < s < 1. The lemma follows. □ 



Proposition 6.2. There is a constant 71 > 0, for which 
P[L^" is concave ] > 1 — A;„exp 



71^ 

1.2 



Proof. Since L^" is piecewise linear and Uj" are equally-spaced, the 
event that L^" is concave is 

kn 1 

An= f] {U*{a';i,) + U*{af^,) - 2U*{af) < 0}. 
i=2 

For a fixed j, let h^j = h k„ + h k„ —2h k„. Then C/jf (a^!f_i) + U^{a^'^i) — 

2U*{af) = Q*hn,j, and 

P[U*{a]l^) + U*{af_,) - 2U*{af) > 0] = P[Q# V, - Q^, > -Q^,]. 

Here Q/i„j = U{a)l^) + U{af_^) - 2U{af) and g/i„j < -^i^w'^/kl. Fur- 
ther, I /in J I < 2 Co \/w/kn by (23), and the variance of hnj{Y,Z) is at most 
2r3'u;^/A;^ by the previous lemma. So, the last displayed expression is at 
most 
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by Bernstein's inequality, [10], page 102. The lemma follows with 71 = 7oW^/ 
(4r3 + 2co7ov^) by summing over j. □ 

The previous two lemmas accomplish Step 2. The next step is similar to 
Lemma 5 in [8]. Recall Marshall's lemma: If /i is a concave function, then 
||C/*-^||<||C/#-/i||. 

Proposition 6.3. If An occurs, then \\U*-U*\\<2\\L^"-U* + U- 
L^"\\ + 2\\L''" - U\\. 

Proof. If An occurs, then L^" is a concave function and, therefore, 
U*-Un< \\U* - L^'i + ||L^" - UnW < 2\\Lt - UnW < 2||L^" -Un + U- 
+ 2||L'=" - [/||. □ 

For the final step, let 

1 " 

Gnf = V^iQtf - Qf) = ^ E[/(^- - Qf\ 

V" i=l 

for /GLi(Q), and ||G„||^ = sup^^^ |G„/| for^FCL^Q). 

Proposition 6.4. There are constants C , Ti > 0, and T2, for which 
(20) and (21) hold for all sufficiently large n. 

Proof. That (20) holds follows from a simple Taylor series expansion, 
as in [8]. 

The inequality (21) requires more effort. First observe that 
||L^-C/#-(L^'"-C/)||= max max |L^(t) - [/#(t) - [L^"(t) - C/(t)]|. 

j-i — — J 

For fixed n and j, let 

(t - 4" 1) V" + (4" - *)^a'= 



and 



^t=ht — - — i-^: — ^ 

a." - af_^ 



fs = ^h* 



2co '"a']-i+s/k„ 

for a^!li < t < aj" and < s < 1. Then |/^| < 1, and the variance of fs{Y, Z) 
is at most cj^ := T\nP' / {Ac^kn) by (23) and Lemma 6.1. Moreover, 

L^(t) - U*{t) - [L^-{t) - U{t)] = Q*hl - Qhl 

max \Q*hl - Qhl\ = max -^^Gnft, 
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r ' 


7 r 


IV- 


exp 


(T. 





1 T 



2 



and there is a constant C for which 

C 

-PlllCnlljc- > r] < — . . ^..^ n 2 , , ^ / /- 

(T* L o"J L 2 cr"^ + (3 + r)/vn 

for all r > by Theorem 2.14.16 of [10]. The condition (2.14.6) of [10] is 
satisfied with V = 2 here by (23). The constant C here does not depend on 
n or J. Thus, combining the last three displayed expressions, letting 



_ 1 /Alog(n) 
2co V K 

and summing over j leads to (21), with r2 = 2{T'i^w'^ + 12co). □ 

Proof of Theorem 2.1. Let kn be the least integer that exceeds [71^/ 
41ogn]^/^. Then kn = 0(n/ logn)^/^ and P{An) > 1 — for all sufficiently 
large n by Proposition 6.2. Choose A > 4r2 in (21). Let Dn be the event 
U^{t) = U*{t) for ah t G [to, ^i]- Then An n Dn implies 



sup \Un-U*\= sup |[/*-C/#|<Ii + ^Ll^l^ = 0(n-ilogn), 

to<t<ti to<t<ti Kn VTl"- 

(26) 

by Propositions 6.1, 6.3 and 6.4. So, for large constant M, 

pf sup \Un-U*\>Me^\<P{A'n)+P{D'n), 

\to<t<ti / 

establishing (13). □ 

7. Proof of Theorem 2.2. Theorem 2.2 can be proved by modifying the 
proof of Theorem 2.1. The following simpler and more transparent proof was 
suggested by a referee. 

Proof of Theorem 2.2. Suppose that to>0 and for \s\ < 1, let 

(S + l)U*{to + en) + (1 - s)U*{to - En) 



Vn{s) = 

+ U{to + ens) 

and 



2 

{S + l)U{to + En) + (1 - s)U{to - Er. 



Rn{s) = \[U*{to + EnS) - Vn{s)]. 



£2 



Observe that Vn is concave and Rn continuous, both on [—1,1]. After some 
algebra, the process Rn may be rewritten as 

1 " 

Rn{s) = —Y.[fs{y^^Zi)- Efs iYuZi)l 
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where 

f js + l)^to+£„ + (1 - S)ht^^sn 

Is — ll'to+£nS 2 

By Lemma 6.1, 



||/t||2<2r3e„ and ||/f - /.lb < Ts^ny log(^|-) |t - s| 
for —1 < s,t < 1. It follows that 

E[Rn{tf] < ^4 < 7^ 

nei log(n) 

and 

<Tl{t- sf \og^ ^ 



t- s\ 



So, Rn are tight in C[— 1,1], Rn{s) — >^ for each |s| < 1, and therefore, 
sup|s|<i \Rn{s)\ — >^0. It follows that 

sup \U*{to + es) - Vn{s)\ = Op{el). 

So, sup|^|<i \U*{to + es) - Vn{s)\ < sup|^|<i \U*{to + es) - K(s)|, and the 
theorem follows from |[/# — f^n| < \ — Vn\ + \ Un — Vnl ■ 

8. Proof of Theorems 3.1 and 3.2. 

Proof of Theorem 3.1. For each x > 0, let 

Zi 

/TT — =l{y,>x}, t = l,...,n. 

Then, for each c > 0, 

>c]= / / g{y,z)dyiy{dz}. 

Jo Jx 

So 

(27) c2p[^r. >c]=y y z^g\xJ^-—^zy{dz]dt^a^{x) 

as c — > oo, if is continuous in a neighborhood of x, using Pratt's theorem 
to justify the interchange of limit and integral. Theorem 3.1 follows easily 
from [3], Theorem 4, page 323. □ 
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Proof of Theorem 3.2. To begin fix < x < oo. From Theorem 2.2 
and more basic considerations, there is a sequence < (5„ < e„ for which 
6n = o(e„), log((5-^) ~ log(e-^) and 



(28) 



sup \Un{x')-U*{x')\=Op{6l). 

\x'—x\<e„ 



Since Un is concave, 

Un{x + 6n) - Unix) 



(29) 
From (28), 



< "^nix) < 



Unix) - Unix - 5n) 



^nix)-^ix) ^ U*{x + 6n)-U*ix)-6n^ix) 

e 5 e 

^nix) - ^ix) ^ U#ix - 6n) - U*ix) - 6n^ix) , 



Here 



E 



U*ix±5n)-U*i, 



■^ix)+0i5n). 



Next, consider the asymptotic variance of Ufix + 5„) — J7jf (x). 



Var[C/#(x + 5n) - U*ix)] = -\s.T[2Zi{J[Yi - x] 

n * 



[Yi-X- 5n] + )] 



n 



£;[4Zf(yi-x)l{,<y,<y^+5„}] 



+ -i?[4Z2(yi^- ^Yi-X-5n)l{Y,>x+5,.)] 



+ -iUix + 5n)-Uix)f. 
n 



It is easy to see that 



E[AZliY, - x)l{,<YMK}\ + -iUix + sn) - Uix))^ = Oi5l), 



n 



provided that / z'^gix, z) dz is continuous at a neighborhood of x, and 

E[4:Zfiy^Yi -X - ^jYi -X- (^n)l{yi>x+<5„}] ~ -(^nlog^n ^ Z^ Qy ^^ix , z) dz 

under the same conditions. So 

■U*ix + 5n)-U*ix) 



Var 



-\og^a'^ix)-^\ela'^ix). 
n On 2 
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from the Lindeberg central limit theorem for triangular arrays. □ 
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